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Summary:  This  paper  will  appear  as  an 
appendix  to  a  chapter  In  a  book  by  E.  F. 
Beckenbach  entitled,  "Mathematics  for 
Engineers,"  to  be  published  by  McClraw— Hill, 
195^*  This  appendix  sketches  briefly  some 
of  the  most  Important  aspects  of  a  part  of 
the  general  theory  of  differential  equations, 
the  stability  theory  of  equilibrium  states. 


EQUILIBRIUM  ANALYSIS: 

THE  STABILITY  THECRY  OF  POINCARE-LIAPOUNOFF  AND  EXTENSIONS 

Richard  Bellman 


§  1 .  Introduc  tlon. 

The  preceding  chapter  has  treated  the  subject  of  linear  and 
nonlinear  oscillations,  a  t^plc  of  the  utmost  Importance  In  the 
theory  and  application  of  differential  equations.  In  this  appen¬ 
dix  we  shall  attempt  to  sketch  briefly  some  of  the  m'-'St  Important 
aspects  of  another  part  of  the  general  theory  of  differential  equa¬ 
tions,  the  stability  theory  of  equilibrium  states. 

The  fundamental  problem  may  be  posed  very  simply.  Let  us  sup¬ 
pose  that  we  have  a  physical  system  described  at  any  time  t  by  a 

set  of  state  variables  (xj  ( t )  ,X2  ( t ) ,  •  •  •  x^^  ( t ) ) .  These  variables  are 
taken  to  vary  with  time  In  accordance  with  a  system  of  differential 
equations , 

(1)  dx^/lt  -  fj^(x,  ,X2  ,•  •  •  ,x..)  ,  X^(C)  -  c^,  1-1, 2, 

By  nn  equilibrium  state,  we  mean  a  set  of  values  ( a  i  ,a2  ,  *  •  *  ,aj^ )  , 

which  possesses  the  property  that 


/ 
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(2)  -  0,  1-1, 2, ••‘N. 

These  values  furnish  a  point  solution  to  (l).  Without  the 
Intervention  of  an  external  force,  the  system  will  I'emaln  In  the 
state  specified  by  -  a^.  If  It  starts  In  this  state. 

Suppose  now  that  some  external  force,  of  either  deterministic 
or  stochastic  origin.  Is  applied  with  the  result  that  (a  i  , ag  ,  •  • ) 
Is  displaced  to  (a|  ,ai  , '  *  *  ,3^^) .  Will  the  system  return  to  Its 
equilibrium  position? 

If  It  does  so  under  all  possible  perturbations,  of  arbitrary 
magnitude,  the  equilibrium  position  Is  said  to  be  tota 1  stable. 

If  the  system  returns  to  Its  equilibrium  position  under  perturba¬ 
tions  of  sufficiently  small  magnitude,  the  equilibrium  position  Is 
sa Id  to  be  stable . 

It  Is  clear  that  total  stability  Is  a  mathematical  fiction,  and 
that  In  physical  problems  the  magnitude  of  the  disturbance  will 
play  an  essential  role  In  determining  the  subsequent  behavior  of  the 
system. 

In  the  succeeding  sections  we  shall  discuss  the  m-^st  Important 
result  In  the  stability  theory  of  nonlinear  differential  equations, 
and  then  pass  lightly  over  some  related  questions  In  the  theory  of 
linear  differential  equations,  differential-difference  equations, 
and  parabolic  partial  differential  equations. 

Further  results  in  stability  theory  and  asymptotic  behavior 
of  differential  equations  will  be  found  In  the  author's  book  [l]  , 
and  previous  survey  [[2j  .  A  survey  of  results  In  the  theory  of  pro¬ 


cesses  Involving  time-lags,  which  lead  to  differential-difference 
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equatlons  will  be  found  In  [3]  »  where  earlier  results  of  M. 
Wright  and  the  author  are  cited.  Recent  Important  work  In  the 
theory  of  nonlinear  parabolic  equations  Is  due  to  G.  Prodl  [q]  , 
and  [lO],  and  earlier  work  Is  summarized  In  a  paper  by  the  au  hor 

w- 


§2 .  The  ftablllty  Theory  of  Poincare  and  Llapounoff. 

Let  us  assume,  as  Is  true  In  the  formulation  of  most  physical 
problems,  that  each  function  f j (xi ,X2  ,  •  • • ,x^}  Is  a  power  series  In 
the  varlabl'»s  x  j  ,Xa  » •  •  *  *X|^. ,  and  take,  without  loss  of  generality, 
eacn  to  be  zero. 

The  basic  system  of  differential  equations  has  then  the  form 


(1) 


dXj^/dt 


9 


where  A  -  (3|j)  Is  a  constant  matrix  and  each  g^{x)  Is  a  power 
series  containing  no  constant  or  first-order  terms. 

Let  us  take  as  Initial  conditions 


(2)  x^(0)  *  c^,  1-1 ,2,- • • ,N, 

where  w>=*  assume  that  the  Cj^  are  chosen  ‘o  be  small  enough  so  that 
each  g^  (x)  Is  small  compared  to  the  linear  terms. 

It  Is  now  plausible  that  tr.e  stability  of  the  equilibrium  posi¬ 
tion  Xi  -  X2  -••••-  X.,  -  '  for  (l)  will  depend  upon  whether  or 

.  1 

not  this  .tate  Is  stable  for  the  linear  approximation 
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(3) 


dXj/dt 


1-1,2, 


,N. 


That  this  Is  Indeed  so  Is  the  substance  of  the  classical 
result  of  Poincare  and  Llapounoff. 

Before  presenting  a  formal  statement  of  the  theorem,  let  us 
consider  the  asymptotic  behavior  of  the  solutions  of  (3).  As  Is 
well  known,  cf.  [l] ,  we  may  obtain  all  solutions  of  (3)  In  "erms 
of  simple  solutions  of  the  type  Cj^,  together  with  limiting 

fonis.  Substitution  in  (3)  yields  the  algebraic  system 


N 


Elimination  of  the  c^,  which  cannot  all  be  zero,  yields  the 
determinants!  equation  |A->Al|  ■  0,  the  characteristic  equation  of 
A.  The  roots  of  this  equation  are  called  the  characteristic  roots 
of  A.  If  multiple  roots  occur,  we  may  obtain  solutions  of  the  form 
Xi  -  e  p^{t) ,  where  the  p^(t)  are  polynomials  In  t. 

In  any  case,  we  see  that  the  asymptotic  behavior  of  the  solu¬ 
tions  of  the  linear  differential  equation  Is  determined  by  the 
algebraic  character  of  the  characteristic  roots.  It  Is  clear  that 
a  necessary  and  sufficient  condition  that  all  solutions  of  (3)  tend 
to  zero  as  t  - ■  >  oo  is  that  all  characteristic  roots  have  negative 
parts. 

This  condition  can  be  tested  without  explicit  calculation  of 
the  roots  by  use  of  the  Hurwltz  criteria,  cf.  ,  once  the  char¬ 
acteristic  equation,  lA-All  -  0,  has  been  written  out  in  polynomial 


fonn 
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L^t  us  now  state  the  fundamental  result  of  Poincare  and 
Llapounoff : 

Theorem  1 . *  Consider  the  system  of  differential  equations  appear¬ 
ing  In  (1).  Let  us  assume  that 

a.  all  characteristic  roots  of  A  have  negative  real  parts, 

(4)  -  - - 

b.  IgjCxi  •  ,Xj^)/(|xi  +  ) - >0  ^ 

|x|-f|xal-f--»-|Xj^| - >  0. 

Then  any  solution  of  (l)  for  which  jcil  -f  |  Ca  |  +  •••  -f  |Cj^|  Is 

sufficiently  small  approaches  zero  as  t  - >  oo. 

This  theorem  affirms  the  correctness  of  using  the  linear 
approximations  to  test  the  stability  of  an  equilibrium  position. 
Several  proofs,  each  of  Independent  Interest,  will  be  found  In  (JlJ  . 

§ ^.  Stability  Theory  of  Linear  Equations. 

The  above  mathematical  formulation  of  the  behavior  of  a  sys¬ 
tem  assumed  statlonarlty ,  which  Is  to  say  that  the  laws  governing 
the  behavior  of  the  system  were  taken  to  be  Invariant  In  time.  In 
many  applications  this  Is  not  the  case. 

Let  us  consider  a  situation  wher^  the  system  Is  governed  by 
a  system  of  linear  equations  with  variable  coefficients, 

N 

(l)  dXj/dt  •  s 

It  Is  reasonable  to  suspect  that  If  bj^j(t)  - >  0  as  t  - >  oo, 

the  asymptotic  behavior  of  the  solution  of  (l)  will  mimic  the 

The  original  result  of  Poincare  and  Llapounoff  assumed  that  the 
gj(x)  were  power  series  In  the  x.  possessing  no  constant  or  first- 
order  terms.  As  stated  above,  trie  result  is  due  to  Perron. 
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behavlor  of  the  solution  of  the  approximate  equation 

N 

(2)  dXj/dt  -  ®1J*J»  1-1, 2, ‘“.N. 

Unfortunately  for  engineers,  and  fortunately  for  ma thematic  lane  , 
this  Is  not  universally  true.  Let  us  give  a  simple  example.  It 
can  be  shown  that  not  all  solutions  of 

(3)  d*x/dt®  (1  ♦  sln2t/t)x  -  0, 

are  bounded,  despite  the  fact  that  the  solutions  of  the  approximat¬ 
ing  equation,  d*x/dt®  4  x  -  0,  are. 

We  have  here  a  typical  problem  In  the  theory  of  the  stability 
of  the  properties  of  an  equation  under  perturbations  of  the  form  of 
the  equation. 

A  useful  result  due  to  Hukuwara,  see  Q]  ,  Is  the  following: 
Theorem  2.  ^ 

a,  all  solutions  of  (2)  are  bounded  as  t  - >oo, 

<5)  TTi 

b.  J  |bjj(t)|!lt  <  oo, 

then  all  solutions  of  . ( 1 )  are  bounded. 

If  more  Is  known  concerning  the  then  correspondingly 

more  can  be  determined  concerning  the  solutions.  A  case  of  par¬ 
ticular  Importance  Is  that  where  each  possesses  an  asymp¬ 

totic  series  of  the  form 
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(6)  b^j(t)^  b^jj/t  -f  b^jg/t*  ■¥•••. 

In  this  case,  asymptotic  series  for  the  solutions  may  be  found. 

A  further  discussion  of  this  very  Important  aspect  of  the  theory 
of  asymptotic  behavior  will  be  found  In  Q]  ,  where  further  refer¬ 
ences  may  be  found. 

§4.  Differential-difference  Equations. 

In  many  Important  applications  Involving  automatic  control, 
an  appreciable  time  Is  required  for  the  controlling  mechanism  to 
react.  In  problems  of  this  type.  In  place  of  a  differential  equa¬ 
tion  we  obtain  a  differential-difference  equation,  and  occasionally 
a  functional  equation  of  more  complicated  type. 

Thus,  for  example.  In  describing  the  motion  of  a  damped  pendu¬ 
lum,  In  place  of  the  traditional  equation, 

(1)  x(t)  +  ai(t)  +  bx(t)  ■  0, 

we  obtain  the  equation 

(2)  x(t)  -f  ax(t-'^  -f  bx(t)  ■  0, 

If  the  damping  control  possesses  a  time  lag  t*. 

The  characteristic  equation  corresponding  to  (l),  obtained 
by  setting  X  •  e^^.  Is 


(5) 


+  a>  -t-  b  •  0 
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If  a  and  b  are  positive  quantities.  It  Is  trivially  seen  that 

•very  solution  of  (1)  goes  to  zero  as  t  - >  oo.  The  equation 

obtained  from  (2)  In  the  corresponding  fashion  Is 

(4)  A*  a  e“^  +  b  -  0. 


It  Is  no  longer  a  trivial  matter  to  determine  the  regions  of  the 
(a,b)  plane  which  yield  equations  with  the  property  that  all  the 
roots  have  negative  real  parts. 

An  Important  paper  attacking  this  problem  Is  by  Pontrjagln  [b] , 
An  English  summary  of  this,  together  with  some  applications  of  the 
methods  contained  In  the  paper,  will  be  found  In  [^3  •  Indepen¬ 
dent  approach  to  a  particular  equation  will  be  found  In  Hayes  [6]. 

The  stability  theory  of  nonlinear  differential-difference 
equations  was  Inaugurated  by  the  author  and  E.  M.  Wright,  [llj,  who 
has  Investigated  these  questions  In  considerable  detail.  A  bib¬ 
liography  will  be  found  In  [3^  • 

Finally,  we  note  that  the  theory  of  periodic  solutions  of 
dlfferentlal-dlf fer*ence  equations  has  been  discussed  by  Mlnorsky 
[73  and  by  Brownell  [^ . 

^ 5-  The  Heat  Equation. 

Stability  problems  of  entirely  analogous  type  arise  In  con¬ 
nection  with  tne  nonlinear  heat  equation. 


+ 


(1) 


5u  _  ;^u 

^  ax* 


+  e(u) , 
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where  the  boundary  and  Initial  conditions  are  of  the  form 

(2)  u  -  0  on  B,  the  boundary  of  a  region  F(x,y,z), 

u  ■  f(x,y,z)  in  R  at  ‘  •  1. 

From  physical  consldera^^ Ion?  It  1?  to  be  expected  that  the 
c  ond 1 1 1  on?  , 

a.  Max  |r|  sufficiently  small, 

(M  R 

b.  r(u)  -  o(u)  as  u  - >  0 , 

will  guarantee  that  the  solution  of  (1)  approaches  zero  a?  t  - 

asrumlng  that  R  Is  a  bounded  region  with  no  particular  oddities. 

There  are  many  wa>s  of  attacking  this  problem.  A  bibliography 
of  previous  work  will  be  found  In  [4]  ,  where  a  solution  Is  obtained 
for  the  case  where  R  Is  a  rectangular  parallelepiped.  A  complete 
solution  for  general  region?  was  obtained  by  P.  Lax,  In  private 
communication,  and  In  published  form  by  G.  Prodl  l^]  ,  who  has  also 
Investigated  other  Interesting  questions  In  this  domain,  cf.  • 


■ 
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